Performance Characterization of Scientific Workflows for the Optimal Use of Burst Buffers
نویسندگان
چکیده
Scientific discoveries are increasingly dependent upon the analysis of large volumes of data from observations and simulations of complex phenomena. Scientists compose the complex analyses as workflows and execute them on largescale HPC systems. The workflow structures are in contrast with monolithic single simulations that have often been the primary use case on HPC systems. Simultaneously, new storage paradigms such as Burst Buffers are also becoming available on HPC platforms. In order to maximize the performance of data analyses workflows today it is critical to determine the characteristics of the workflows. Obtaining a deeper understanding of the workflows helps us identify opportunities to leverage the capabilities of the Burst Buffer. In this paper, we analyze the performance characteristics of the Burst Buffer and two representative scientific workflows. We measure the performance of these workflows using the Burst Buffer, allowing us to make recommendations for future optimal usage of workflows using Burst Buffer.
منابع مشابه
A Clustering Approach to Scientific Workflow Scheduling on the Cloud with Deadline and Cost Constraints
One of the main features of High Throughput Computing systems is the availability of high power processing resources. Cloud Computing systems can offer these features through concepts like Pay-Per-Use and Quality of Service (QoS) over the Internet. Many applications in Cloud computing are represented by workflows. Quality of Service is one of the most important challenges in the context of sche...
متن کاملCatalytic Performance and Characterization of Promoted K-La/ZSM-5 Nanocatalyst for Biodiesel Production
The promoted K-La nanocatalysts supported on ZSM-5 zeolite were prepared via wetness impregnation method and tested for biodiesel production from soybean oil. The effects of different weight percentage of La, loading of K as a promoter and calcination conditions on structure and activity of catalyst were investigated. Results showed that the supported catalyst containing 7wt.% of La was pro...
متن کاملKCl Promoted Cobalt-iron Nanocatalysts Supported on Silica: Catalytic Performance and Characterization in Fischer-Tropsch Synthesis
The SiO2 supported cobalt-iron nano catalysts were prepared by the sol-gel method. This research investigated the effects of (Co/Fe) wt.%, different Co/Fe ratio at different temperature and loading of KCl wt.% for Fisher-Tropsch synthesis (FTS). The results were showed that the catalyst containing 50 wt.% (Co/Fe)/SiO2 (Co/Fe ratio is 70/30) which promoted with 0.6 wt.% KCl is an optimal nano ca...
متن کاملUncertain Resource Availabilities: Proactive and Reactive Procedures for Preemptive Resource Constrained project Scheduling Problem
Project scheduling is the part of project management that deals with determining when intime to start (and finish) which activities and with the allocation of scarce resources to theproject activities. In practice, virtually all project managers are confronted with resourcescarceness. In such cases, the Resource-Constrained Project Scheduling Problem (RCPSP)arises. This optimization problem has...
متن کاملPerformance comparison between Optical Burst Switching and Deflection Routing
Optical packet-switched networks of the near future will likely use no or very small number of optical buffers. We compare the delay-throughput performance of deflection routing and optical burst switching because both do not require the use of optical buffers. Simulations show that the simple packet drop-andretransmit contention resolution strategy of optical burst switching has a better perfo...
متن کامل